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Abstract. The paper addresses an approach to ordinal assessment of alterna- 
tives based on assignment of elements into an ordinal scale. Basic versions of 
the assessment problems are formulated while taking into account the number 
of levels at a basic ordinal scale [1,2,. ..,1] and the number of assigned elements 
(e.g., 1,2,3). The obtained estimates are multisets (or bags) (cardinality of 
the multiset equals a constant). Scale-posets for the examined assessment 
problems are presented. "Interval multiset estimates" are suggested. Further, 
operations over multiset estimates are examined: (a) integration of multiset 
estimates, (b) proximity for multiset estimates, (c) comparison of multiset es- 
timates, (d) aggregation of multiset estimates, and (e) alignment of multiset 
estimates. Combinatorial synthesis based on morphological approach is exam- 
ined including the modified version of the approach with multiset estimates 
of design alternatives. Knapsack-like problems with multiset estimates are 
briefly described as well. The assessment approach, multiset-estimates, and 
corresponding combinatorial problems are illustrated by numerical examples. 



In this article, a combinatorial approach to ordinal assessment of alternatives 
is suggested. The approach consists in assignment of elements (1,2,3, ...) into an 
ordinal scale [1, 2, I]. As a result, a multi-set based estimate is obtained, where a 
basis set involves all levels of the ordinal scale: ft = {1, 2, 1} (the levels are linear 
ordered: 1 >- 2 y 3 y ...) and the assessment problem (for each alternative) consists 
in selection of a multiset over set A while taking into account two conditions: 

1. cardinality of the selected multiset equals a specified number of elements 
rj = 1, 2, 3, ... (i.e., multisets of cardinality 7/ are considered); 

2. "configuration" of the multiset is the following: the selected elements of fl 
cover an interval over scale [1,1] (i.e., "interval multiset estimate"). 

Note, fundamentals of multisets can be found in ( [1] , [7] , [32] , [36] ) . Evidently, 
the assessment case n = 1 corresponds to traditional ordinal assessment. Thus, 
an estimate e for an alternative A is (scale [1,1], position-based form or position 
form): e(A) — (r)%, r] L , r]i), where r\ L corresponds to the number of elements at 
the level i (i = 1, 1). Here, the conditions above are: 

Condition 1: 5Z t=1 f? t = n (or |e(A)| = n). 

Condition 2: if rj L > and r/ L +2 > then t] l+ i > (l = 1, 1 — 2). 
On the other hand, the multiset estimate is: 



1. Introduction 



e(A) = {!,..., 1,2,... 2, 3,..., 3,..., 




I, ..,/}. 
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The number of multisets of cardinality r), with elements taken from a finite set of 
cardinality I, is called the "multiset coefficient" or "multiset number" ([7].}32 J .[36 j ): 

(0) ~ i{i+i){i+2) '" ii+v ' i) -t^ +v ~ i y 

This number corresponds to possible estimates (without taking into account interval 
condition 2). In the case of condition 2, the number of estimates is decreased. 

Example 1. The ordinal assessment is the following: (a) the basic ordinal 
scale (basic set) is: il = {1, 2, 3, I}, (b) the number of elements or cardinality of 
multiset (estimate) is: r\ = 1. Estimates are: 

e? = {1} and position-based form = (1, 0, 0, 0), 
= {2} and position-based form e§ = (0, 1, 0, 0), 
= {3} and position-based form e% = (0, 0, 1, 0), 
... , 

= {/} and position-based form = (0, 0, 0, 1). 

Example 2. The basic ordinal scale (basic set) is: ft = {1,2,3,4}, the number 
of elements or cardinality of multiset (estimate) is: rj = 3. 

Case 1. Estimates corresponding to basic ordinal assessment are: e° = {1, 1, 1} 
or in position-based form e° = (3,0,0,0); e 2 = {2,2,2} or in position-based form 
e° 2 = (0,3,0,0); e% = {3,3,3} or in position-based form eg = (0,0,3,0); e% = 
{4, 4, 4} or in position-based form e% = (0, 0, 0, 3). 

Case 2. Examples of correct estimates are: e[ — {1,2,3} or in position-based 
form e[ = (1,1,1,0); e' 2 — {2,2,3} or in position-based form e' 2 = (0,2,1,0); 
e' 3 = {4, 4, 4} or in position-based form e' 3 = (0, 0, 0, 3). 

Case 3. Examples of incorrect estimates are: e'{ = {1,1,3} or in position-based 
form e'{ = (2,0,1,0); e' 2 ' = {1,3,4} or in position-based form e 2 = (1,0,1,1); 
e'l = {2, 4, 4} or in position-based form e' 3 ' = (0, 1, 0, 2). 

Basic versions of the assessment problems are formulated as P l,v : (i) traditional 
assessment based on ordinal scale [1,2,3]: P 3,1 ; (ii) traditional assessment based 
on ordinal scale [1, 2, 3, 4]: P 4,1 ; (iii) assessment over ordinal scale [1, 2, 3] based on 
assignment of two elements: P 3,2 ; (iv) assessment over ordinal scale [1,2,3] based 
on assignment of three elements: P 3,2 ; and (v) assessment over ordinal scale [1, 2, 3] 
based on assignment of four elements: P 3,4 . In the article, the obtained scale-posets 
are presented and corresponding alternative evaluation and composition problems 
are described. In the case rj > 2, the suggested assessment approach can be consid- 
ered as a very simplified discrete version of fuzzy set based assessment (e.g., [37], 
[39]). Fig. 1 depicts a framework of our assessment approach. 

Further, operations over multiset estimates are examined: (a) integration of 
multiset estimates, (b) proximity for multiset estimates, (c) comparison of multi- 
set estimates, (d) aggregation of multiset estimates (e.g., searching for a median 
estimate), (e) alignment of multiset estimates (and corresponding assessment prob- 
lems). Combinatorial synthesis based on morphological approach is examined in- 
cluding the suggested modified version of the approach with multiset estimates of 
design alternatives. In addition, some knapsack-like problems with multiset esti- 
mates are briefly described as well. The assessment approach, multiset-estimates 
and the problems above are illustrated by numerical examples. 
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Fig. 1. Framework of assessment approach 



2. Basic Assessment Problems 

In this section, several basic assessment problems are considered (P 3 ' 1 , P 4 ' 1 , 
P 3 ' 2 , P 3,3 , P 3,4 ) (Table 1): assessment scale, order over the scale components. 



Table 1. Basic assessment problems 
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Fig. 2 illustrates the scale and estimates for problem P 3,1 (ordinal assessment, 
scale [1,3]). In the case of scale [1,2,3], the following semantic levels are often con- 
sidered: excellent (1), good (2), and sufficient (3). Analogically, Fig. 3 illustrates 
the scale and estimates for problem P 4 ' 1 (ordinal assessment, scale [1,4]). 
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Fig. 2. Scale, estimates (P 3 ' 1 ) 



Fig. 3. Scale, estimates (P 4,1 ) 



4 



MARK SH. LEVIN 



Fig. 4 illustrates the scale-poset and estimates for problem P 3,2 (assessment 
over scale [1,3] with two elements; estimate (1,0, 1) is not used). 
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Fig. 4. Scale, estimates (P 3,2 ) 

Fig. 5 illustrates the scale-poset and estimates for problem P 3,3 (assessment 
over scale [1,3] with three elements; estimates (2,0, 1) and (1,0,2) are not used). 
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Fig. 5. Scale, estimates (P 3 ' 3 ) 



Fig. 6 illustrates the scale-poset and estimates for problem P 3,4 (assessment 
over scale [1, 3] with four elements; estimates (2, 0, 2), (3, 0, 1), and (1, 0, 3) are not 
used). 
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3. Operations over Multiset Estimates 

The following operations are considered for the multiset estimates (or corre- 
sponding alternatives): (a) integration of several estimates (e.g., for composite 
systems), (b) proximity between estimates and comparison of the estimates, (c) 
comparison, ordering, selection of Pareto-emcient estimates (alternatives) , and (d) 
aggregation (e.g., searching for a median estimate for the specified set of initial 
estimates). 

3.1. Integrated Estimates. Integration of estimates (mainly, for composite sys- 
tems) is based on summarization of the estimates by components (i.e., positions). 
Let us consider n estimates (position form): estimate e 1 = (t]l, rfc, rjj), . . ., es- 
timate e K — (r/i , ?7f, rjf), . . ., estimate e" = (77™, 77™, rjf). Then, the in- 
tegrated estimate is: estimate e 1 = (r]{, rrf, rjf), where r\{ = X^"=i V? = 1,1. 
In fact, the operation 1+J is used for multiset estimates: e 1 = e 1 1+J ... 1+J e K 1+J ... 1+J e n . 
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Further, some examples for integration of multiset-estimates are presented. 

Example 3. S = X * Y * Z . Assessment problem P 3 ' 1 . Estimates of system 
parts are: (a) X 1 : e{X l ) = {1} or e(A 4 ) = (1,0,0), (b) Y i : e{Y l ) = {2} or 
e(Y' L ) = (0, 1,0), (c) Z l : e(Z l ) = {1} or e(Z l ) = (1, 1,0). As a result, the integrated 
estimate of composite system is (component-based summarization): 

S l = X 1 * Y l * Z l : e(S l ) = {1, 1, 2} or e(S l ) = (2, 1, 0). 

Example 4. 5 = X*y*Z*T^. Assessment problem P 3,1 . Estimates of system 
parts are: (a) X u : e(X u ) = {1} or e(A") = (1,0,0), (b) F": e(Y u ) = {2} or 
e(F 14 ) = (0,1,0), (c) Z H : e(Z u ) = {1} or e{Z u ) = (0,1,0), (d) V u : e(V u ) = {3} 
or e(V 11 ) = (0,0,1). As a result, the integrated estimate of composite system is 
(component-based summarization): 

s a = X it + yti ^ Z it ^ yu. e ^i^ = | X) 2j 2, 3} or e(S u ) = (1, 2, 1). 

Example 5. S = X *Y * Z. Assessment problem P 3 ' 2 . Estimates of system 
parts are: (a) X ui : e(X Ut ) = {1} or e{X lU ) = (1,1,0), (b) Y iu : e(Y Ut ) = {2} 
or e(Y Ui ) = (0,1,0), (c) Z lU : e{Z lU ) = {1} or e(Z Ut ) = (0,2,0). As a result, the 
integrated estimate of composite system is (component-based summarization) : 

giii = x m ^ yiu ^ z m. e (sm) = {i, 2, 2, 2, 2} or e(S lU ) = (1, 4, 0). 

Example 6. S = X * Y * Z. Assessment problem P 3 ' 3 . Estimates of system 
parts are: (a) A w : {1} or (1,1,1), (b) Y iv : {2} or (1,2,0), (c) Z m : {1} or 
(0,2,1). As a result, the integrated estimate of composite system is (component- 
based summarization: S iv = X iv * Y m * Z m : {1, 1, 2, 2, 2, 2, 3, 3} or (2, 5, 2). 

Example 7. S = X * y * Z. Assessment problem P 3 ' 4 . Estimates of system 
parts are: (a) X v : e(X v ) = {1} or e(X v ) = (1,2,1), (b) Y v : e(Y v ) = {2} or 
e(Y v ) = (2,2,0), (c) Z v : e(Z v ) = {1} or e(Z v ) = (1,1,2). As a result, the 
integrated estimate of composite system is (component-based summarization) : 

S* =X V *Y V *Z V : e(S v ) = {1, 1, 1, 1, 2, 2, 2, 2, 2, 3, 3, 3} or e(S v ) = (4, 5, 3). 

Generally, the integrated multiset estimate for multi-part system is based on 
assessment problem p l ^ xm (case of complete poset, i.e., without condition 2 on 
"interval"), where P l ' v is assessment problem for system parts, m is the number of 
subsystems (parts). 

Example 8. S = X * Y * Z. Assessment problem P 3,4 . 

The integrated estimate for S is based on the assessment problem P 3 < 12 (case of 
complete poset). 

Example 9. S = X *Y * Z. Assessment problem P 4,3 . 

The integrated estimate for S is based on the assessment problem P 4,9 (case 
of complete poset). Estimates of system parts are: (a) X m% : e(X ml ) = {1} or 
e(X vii ) = (3,0,0,0), (b) Y vii : e(Y mt ) = {2} or e(Y vii ) = (0,3,0,0), (c) Z ml : 
e(Z vU ) = {1} or e{Z ml ) = (0,0,0,3). As a result, the integrated estimate of 
composite system is (component-based summarization): 

gvii = X v It + Y vU * Z ml : e(S mt ) = {1, 1, 1, 2, 2, 2, 4, 4, 4} or e(S v ) = (3, 3, 0, 3). 
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This example is the reason to use the complete poset for the integrated multiset 
estimate. 

3.2. Vector-like Proximity. Consider estimates of two alternatives e{A\), e(A 2 ) 
and the following vector-like proximity: 

S(e(A 1 ),e(A 2 )) = (S-(A 1 ,A 2 ),S+(A 1 ,A 2 )), 

where vector components are: (i) 6~ is the number of one-step changes: element of 
quality l + 1 into clement of quality i (i = 1, 1 — 1) (this corresponds to "improve- 
ment"); (ii) S + is the number of one-step changes: element of quality l into element 
of quality i + 1 [l = 1, 1 — 1) (this corresponds to "degradation"). 

This definition corresponds to change (edition) of Ai into A 2 . Vector-like proxim- 
ity 5(e(Ai)i e(A 2 )) is similar to vector-like proximity for rankings that was suggested 
in ( [10] , [11] , [18] ) . Evidently, the following axioms are satisfied: 

1. VA U A 2 : S(e(A 1 ),e(A 2 )) h (0,0) (nonnegativity). 

2. (5(e(Ai),e(Ai)) = (0,0) (identity). 

3. VA U A 2 : 5(e(A 1 ),e(A 2 )) = (8~ (e(A 1 ), e(A 2 )), S+(e(A 1 ), e{A 2 ))), 
5{e{A 2 ),e{M)) = (S-(e(A 2 ), e{A x )), S+(e(A 2 ), e(^))) = 
{5+{e{A 1 ),e{A 2 )l8-{e{A 1 le{A 2 ))), 

4. VA lf A 2 , A 3 : <S(e(Ai), e(A 2 )) + S(e(A 2 ), e(A 3 )) t ^{A^, e(A 3 )), here opera- 
tion '+' corresponds to summarization by components (triangle inequality). 

In addition, the following is defined: |<5(ei,e2) = |<V(ei,e2)| + |<5 + (ei, e 2 )\. Evi- 
dently, |<5(ei, e 2 )\ < 7j x (/ — 1). Fig. 7 depicts the domain of the proximity. 




Fig. 7. Discrete domain of proximity 



Now, let us consider numerical examples of the proximity. 
Example 10. Assessment problem P 3 ' 1 . 

Case 1. ex = (0, 0, 1), e 2 = (0, 1, 0), S(e u e 2 ) = (1, 0), 5(e 2 , e x ) = (0, 1). 
Case 2. e x = (0,0,1), e 2 = (1,0,0), S(e u e 2 ) = (2,0), 5{e 2 ,e x ) = (0,2). 

Example 11. Assessment problem P 4 ' 1 . 

Case 1. e x = (0, 0, 0, 1), e 2 = (0, 1, 0, 0), S(e u e 2 ) = (2, 0), 5{e 2 , ei) = (0, 2). 
Case 2. e x = (0, 0, 0, 1), e 2 = (1, 0, 0, 0), <J(ei, e 2 ) = (3, 0), 5(e 2 , ei) = (0, 3). 

Example 12. Assessment problem P 3 ' 2 . 

Case 1. e x = (0, 0, 2), e 2 = (0, 1, 1), «S(ei, e 2 ) = (1, 0), S(e 2 ,ex) = (0, 1). 
Case 2. ei = (0,0,2), e 2 = (0,2,0), <5(ei,e 2 ) - (2,0), 5(e a ,ei) = (0,2). 
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Case 3. ei = (0,0,2), e 2 = (2,0,0), 5(ei,e 2 ) - (4,0), 5(e 2 ,ei) - (0,4). 
Example 13. Assessment problem P 3 ' 3 . 

Case L ei = (0, 0, 3), e 2 = (0, 1, 2), 5(e 1; e 2 ) - (1, 0), S(e 2 , ei) = (0, 1). 
Case 2. ei - (0, 0, 3), e 2 = (0, 2, 1), <J(ei, e 2 ) = (2, 0), 5{e 2 ,e 1 ) = (0, 2). 
Case 5. d = (0,0,3), e 2 = (3,0,0), S(e 1 ,e 2 ) = (6,0), 5(e 2 ,ei) = (0,6). 
Case 4. ei = (0, 3, 0), e 2 = (1, 1, 1), 5(e 1; e 2 ) = (1, 1), S(e 2 , ei) = (1, 1). 

Example 14. Assessment problem P 3 ' 4 . 

Case J. ei = (0,0,4), e 2 - (0,1,3), d{e u e 2 ) = (1,0), 5(e 2 ,ei) - (0,1). 
Case g. ei = (0, 0, 4), e 2 = (0, 3, 1), 5(e u e 2 ) = (3, 0), 6(e 2 , ei) - (0, 3). 
Case 5. ei - (0,0,4), e 2 = (4,0,0), <5(ei,e 2 ) = (8,0), <S(e 2 ,ei) = (0,8). 
Case 4. ei = (0, 4, 0), e 2 = (1, 2, 1), <J(ei, e 2 ) = (1, 1), 5(e 2 , ei) = (1, 1). 
Case 5. e x = (1, 1, 2), e 2 - (0, 4, 0), S(e u e 2 ) = (2, 1), 5(e 2 , ei) = (1, 2). 

Further, for two alternative Ai and A 2 their proximity is: <5(ei(Ai), e 2 (A 2 )) = 
(<5~,5 + ). Generally, the following is satisfied: 

1. 6~ = and 5+ > ^> A x >- A 2 . 

2. 5- >0 and <5+ = ^ A x < A 2 . 

3. 8~ > and <5+ > ^=^> Ai and A 2 are incomparable. 

3.3. Comparison of Estimates. In our study, the following comparison problems 
over estimates are considered: 

1. Comparison of two estimates. This operation is based on estimate proximity. 

2. Ordering of estimates from a specified set of estimates. This operation cor- 
responds to a well-known linear ordering algorithm while taking into account in- 
comparable estimates (as "equivalent" ones). The computing complexity of the 
operation is O(nlgn) (n is the number of estimates). 

3. Selection of Pareto-efficient estimates for a specified set of estimates. Here 
the simple algorithm is the following. The proximity matrix can be computed and a 
Pareto-efficient estimate (alternative) has its line without matrix element -< (or >-). 
The computing complexity of the algorithm is 0(n 2 ) (n is the number of estimates). 
The basic linear ordering algorithm leads to the same result (complexity: O(nlgn)), 
but the described algorithm is more friendly for interactive procedure. 

Evidently, in special cases the similar algorithms can be used to search for the 
"maximal" or the "minimal" estimate. 

Example 15. Assessment problem P 3,3 . 

The set of estimates is (Fig. 5): e^' 3 = (0,3,0), ef 3 = (1,1,1), e| 3 = (0,2,1), 
e 3 / 3 = (0,1,2), e 3 / 3 = (0,0,4). Proximities for the estimates are presented as 
proximity matrix in Table 2. Pareto-efficient estimates are: e 3 ' 3 , e 3 ' 3 . Here the 

3 3 

"minimal" estimate exists: e 8 ' . 

Example 16. Assessment problem P 3 ' 4 . 

The set of estimates is (Fig. 6): e 3 ' 4 = (2,1,1), e 3 ' 4 = (0,4,0), e 3 ^ 4 = (1,2,1), 
e 3 ;' 4 = (0,2,2), e 3 ' 4 = (0,1,3), eg' 4 = (0,0,4). Proximities for the estimates are 
presented as proximity matrix in Table 3. Pareto-efficient estimates are: e 9 ' , e 3 ' . 
Here the "minimal" estimate exists: eo' 4 . 
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3.4. Aggregation of Estimates. Here searching for a median estimate for the 
specified set of initial estimates is considered. Let E — {e\, e K , e„} be the 
set of specified estimates (or a corresponding set of specified alternatives), let D 
be the set of all possible estimates (or a corresponding set of possible alternatives) 
(E C D). Thus, the median estimate is (e.g., [18], [31]): 
(a) "generalized median" : 



M 9 



argmm 



|+J 5(M,e K ) |; 

K = l 

(b) simplified case of the median (approximation) as "set median" over set E: 

n 

argmin 



M s 



MeE 



The problem of searching for the "generalized median" is usually NP-hard, com- 
plexity of searching for "set median" is a polynomial problem (0(n 2 )). In our study, 
simple problems are considered where the set of all multiset estimates is very lim- 
ited (i.e., "multiset number") and simple enumerative solving schemes can be used 
for "generalized median" . 



Example 17. Assessment problem P 3,4 . 

The initial set of estimates E is (Fig. 6): e 3,4 = (3,1,0), e 3,4 = (1,3,0), 
4 4 = (0,4,0), ef 4 = (2,1,1), 4 4 = (1,2,1), e 3 / = (0,2,2), ef 4 = (0,1,3), 
e 3 ^ 4 = (0,0,4). Table 4 contains proximities and the integrated estimate: T K — 
l+JjG-E 8{e K ,ej). The median estimates are: (a) "generalized median" M 9 — = 
(0, 3, 1) (e 3 6 ' 4 eE); (b) "set median" M s = e\' 4 = (1,2, 1) (e\' 4 e E). 
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Table 4. Proximities <5(e 



3,4 3, 4) 

^ ' 3 ' 



3,4 
e 2 = 

e 4 — 

3,4 _ 

e 5 — 

3,4 _ 

e 9 — 

3,4 _ 

e 10 — 

3,4 _ 

e 7 — 

e 3 ' 4 - 
i : _ 

e 12 — 



(3,1,0) 
(1,3,0) 
(0,4,0) 
(2,1,1) 
(1,2,1) 
(0,2,2) 
(0,1,3) 
(0,0,4) 



e 4 



3,4 



3,4 



=3,4 
-10 



3,4 
e 7 



3,4 



e 12 



(0,0 

(2,0 
(3,0 
(2,0 
(3,0 
(5,0 
(6,0 
(7,0 



(0,2 
(0,0 
(1,0 

(1,1 
(1,0 
(3,0 
(4,0 
(5,0 



(0,3) 
(0,1) 
(0,0) 
(1,2) 

(1,1) 
(2,0) 
(3,0) 
(4,0) 



(0,2) 
(1,1) 
(2,1) 
(0,0) 
(1,0) 
(3,0) 
(4,0) 
(5,0) 



(0,3) (0,5 

(0,1) (0,3 

(1,1) (0,2 

(0,1) (0,3 

(0,0) (0,2 

(2,0) (0,0 

(3,0) (1,0 

(4,0) (2,0 



Now, let us define the deviation of the median estimate 
A(M) = (A"(M), A+(M)), A~(M) = S(M, min_e K ), A+ 

K — 1,71 

In addition, |A(M)| = max{|A-(M)|, |A+(M)|}. 



0,6 
0,4 
0,3 
0,4 
0,3 
0,1 
0,0 
1,0 



(0,7) 
(0,5) 
(0,4) 
(0,5) 
(0,4) 
(0,2) 
(0,1) 
(0,0) 



(0,28) 
(3,15) 
(7,H) 
(4,16) 
(6,10) 
(15,3) 

(21,1) 
(28,0) 



M 9 or M s ): 

M) = (5(max e K ,M). 

k— l,n 



Example 18. (Assessment problem P 3 ' 4 , from the previous section). The initial 
set of estimates E is (Fig. 6): e 3 / 4 , e 3 ' 4 , e 3 ' 4 , e\' A , e 3 4 , e 3 ' 4 , eg' 4 , e 3 ^ 4 . The median 
estimates are: (a) "generalized median" M 9 = e 6 ' = (0,3,1); (b) "set median" 
M s = e 3 4 = (1, 2, 1). The dispersions are: 

A"(M») = £((0, 3,1), (0,0, 4)) - (0,3), A+(M 9 ) = 5((3, 1,0), (0,3,1)) = (0,4); 
|A(M»)| = 4. 

A"(M S ) = <5((1,2,1),(0,0,4)) = (0,4), A+(M S ) = <5((3, 1, 0), (1, 2, 1)) = (0,3); 
|A(M S )| =4. 

3.5. Alignment of Estimates. Let {e 1 L ' I?1 , e' i,T,i , eJ l "' T '"} be an initial set of 
n multiset estimates. The alignment problem is: 

In general, solving approach to this problem has to be based on special applied 
analysis by the domain expert (s). Let us consider a simplified approach to alignment 
of multiset alternatives as follows (Fig. 8): 

ph,m P i,v^ vi = T~H, I = max{k}, V = max{r?i}. 

i—l.n i=l,n 



( Vi = 



\ 



Vv 



(;"-;') 

v[ ... ^(W) 



1 ... V 

(a) P 1 '"' 



1' ... ' J' 



1 ... /' 1 ... J' ... I" 

(b) P r ^' P 1 "^', V < I" 



Fig. 8. Alignment of multiset estimates 

Example 19. The initial set of multiset estimates is: e 3,2 = (1,1,0), e 3 ,' 3 = 
(1, 1, 1), e 2 / 3 = (2, 1), e 4 ' 4 = (0, 2, 1, 1), e 3 ' 4 = (1, 2, 1), Fig. 9 depicts alignment. 
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e\' 2 : (1,1,0) 



e 3 /: (1,1,1) 



«£': (2,1) 



e$ A : (0,1,2,1) 









1 


2 











1 2 3 



1 2 



12 3 4 



ef: (1,2,1) 



1 2 3 



4,4. (3,1,0,0) 
1 ' 1 2 3'4' 



4 4 : (2,1,1,0) 



12 3 4 



4,4 



(3,1,0,0) 



12 3 4 



e 4 ' 4 : (0,1,2,1) h 



12 3 4 



4,4 



(1,2,1,0) 



12 3 4 



Fig. 9. Example of estimate alignment 



4. Combinatorial Synthesis (morphological approach) 

Here system composition as combinatorial synthesis of design alternatives (for 
system components) which are evaluated via the suggested assessment approach 
is examined. An additional problem consist in integration of design alternatives 
estimates into the total estimate of the composed system. This estimate inte- 
gration is based on summarization of component estimates by estimate elements 
(i.e, position). As a result, system estimates are based on some analogical poset- 
like scales. This case corresponds to combinatorial synthesis in Hierarchical Mor- 
phological Multicriteria Design (HMMD) method. Descriptions of HMMD are 
presented in accessible literature: (i) two books ([TT],[TS]); (ii) journal articles 
( [2] , [E] , [13] , [14] , [17] ) ; (hi) electronic preprint [19^. The method is based on mor- 
phological clique problem. In basic HMMD method, ordinal assessment for design 
alternatives is used (e.g., problems P 3 ' , P 4 ' 1 ). The section contains the following: 

(1) a brief description of basic HMMD method (combinatorial synthesis with 
ordinal assessment of design alternatives); 

(2) two numerical examples for basic HMMD method (three-component system 
and four-component system); and 

(3) modified version of HMMD method that is based on the suggested multi- 
set estimates for evaluation of design alternatives (numerical examples: (i) three- 
component system and assessment problem P 3 ' 3 , (ii) four-component system and 
assessment problem P 3 ' 4 , and (iii) three-layer hierarchical system. 

Table 5 contains a list of the described combinatorial synthesis problems. 



Table 5. Problem of combinatorial synthesis 





Number of 


Number of 


Assessment 


Type of 


Version of 




system layers 


system parts 


problem 


estimate for DAs 


HMMD 


1 


2 


3 


p31 


ordinal 


basic 


2 


2 


4 


p41 


ordinal 


basic 


3 


2 


3 


p33 


multiset 


modified 


4 


2 


4 


p34 


multiset 


modified 


5 


3 


3 


p33 


multiset 


modified 



12 



MARK SH. LEVIN 



4.1. Basic Combinatorial Synthesis (ordinal assessment of alternatives). 

An examined composite (modular, decomposable) system consists of components 
and their interconnection or compatibility (IC). Basic assumptions of HMMD are 
the following: (a) a tree-like structure of the system; (b) a composite estimate for 
system quality that integrates components (subsystems, parts) qualities and qual- 
ities of IC (compatibility) across subsystems; (c) monotonic criteria for the system 
and its components; (d) quality of system components and IC are evaluated on the 
basis of coordinated ordinal scales. The designations are: (1) design alternatives 
(DAs) for leaf nodes of the model; (2) priorities of DAs (i = 1, 1; 1 corresponds to the 
best one); (3) ordinal compatibility for each pair of DAs (w — l,u; v corresponds 
to the best one). The basic phases of HMMD are: 

Phase 1. design of the tree-like system model; 

Phase 2. generation of DAs for leaf nodes of the model; 

Phase 3. hierarchical selection and composing of DAs into composite DAs for 
the corresponding higher level of the system hierarchy; 

Phase 4- analysis and improvement of composite DAs (decisions). 
Let S be a system consisting of m parts (components): R(l), R(i), • R(m). 
A set of design alternatives is generated for each system part above. The problem 
is: 

Find a composite design alternative S — 5(1) * ... * S(i) * ... * S(m) of DAs 
(one representative design alternative S(i) for each system component/part R(i), 
i = l,m ) with non-zero compatibility between design alternatives. 

A discrete space of the system excellence on the basis of the following vector is 
used: N(S) — (w(S); e(S)), where w(S) is the minimum of pairwise compatibility 
between DAs which correspond to different system components (i.e., V Rj 1 and 
Rj 2 > 1 < .h 32 < m) in S, e(S) = (771, r\ t , r\i), where r] l is the number of 
DAs of the ith quality in S. Thus, the modified problem is (two objectives, one 
constraint): 

max e(S), 
max w(S), 
s.t. w(S) > 1. 

As a result, we search for composite decisions which are nondominated by N(S) 
(i.e., Pareto-efficient solutions). "Maximization" of e(S) is based on the correspond- 
ing poset. The considered combinatorial problem is NP-hard and an enumerative 
solving scheme is used. 

4.2. Example: basic HMMD, three-component system. Here three compo- 
nent system and assessment problem P 3,1 are examined. Fig. 10 illustrate the 
composition problem by a numerical example, Table 6 contains compatibility esti- 
mates. In the example, Pareto-efficient composite DAs are: 

(a) Sr = X x *Y! * Z 2 , JV(5i) = (3; 1, 1, 1); 

(b) S 2 = X 2 * Y l * Z 2 , N{S 2 ) = (2; 2, 0, 1); and 

(c) Ss = X3*Y i *Z 1 , N(S 3 ) = (1;3,0,0). 

Fig. 11 depicts the poset for integrated system estimate by components, Fig. 12 
depicts the general poset of system quality. 
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i S = X-kY*Z 
S x = Xi * Y x * Z 2 

5 2 = X2 -kl\-k Z 2 

53 — X3 ★ Y 2 * Z\ 



X Y 



*s(l) 



> 2 (1) 



■<•> 



^(3) 

Fig. 10. Example of composition 
The ideal 



e(S 3 ) 



2,1,0 >) 6(5*2) 



e(Si) 



^ 2, O.l^fcl, 2, 0>) 
^ 1,1,1 >) 0,3,0 >) 
< <: 1,0,2 >) (<0,2,1>) 



£o,l,2>) 



The worst 



(<0,0,3 >) P° mt 
Fig. 11. Poset e(S) = (m,m,V3) 



Tabic 6. Compatibility 





Y 1 


Y 2 


Y 3 


n 


Zi 


z 2 


Z 3 


x l 


3 














3 





x 2 


2 





1 


1 





2 


2 


A3 





1 








1 








Yi 













3 


2 


Y 2 










1 








Y 3 










1 


1 


2 


Y 4 













2 


3 



The. ideal 
point 




w = 2 
"to = 1 

Fig. 12. Poset of system quality N(S) 



4.3. Example: basic HMMD, four-component system. Here the following 
composition problem is considered: 

(i) the system consists of 4 components, 

(ii) assessment problem P 3 ' 1 is used for the evaluation of DAs for components 
(Fig. 2), and 

(hi) integrated system quality is based on poset (Fig. 13). 

Let us describe the corresponding numerical example (a corrected version of the 
example from [§]). The system structure and DAs are presented in Fig. 14 (ordinal 
estimates of DAs are shown in parentheses). In addition, estimates of compatibility 
between DAs (scale [0,1,2,3,4,5]) are presented in Table 7. Resultant Pareto- 
efheient composite DAs are: 

(a) S! = X 3 * Y 5 * Z 3 * Vi, iV(^)(4; 1,3, 0); 

(b) S 2 = X 3 *Y 5 *Z 2 *V 5l N{S 2 ) = (3; 2, 2,0); and 

(c) S 3 = X 3 * Y 3 * Z 2 * V 4 , N(S 3 ) = (2; 3, 1, 0). 
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Fig. 13 illustrates the poset of quality for obtained composite DAs by compo- 
nents (i.e., e(S) = (771, 772, 773)). The general poset of quality (by N(S)) is depicted 
in Fig. 15. 



e(Ss) 



(<3,1,0>) 



(<3,0,1>) g 2,2,0 >) ' 



e(5 2 ) 
e(5i) 



(<2,1,1>) (< 1,3,0 >) ' 



(<2,0,2>) £ 1,2,1 >) ( < 0,4,0 >) 



(< 1,1,2>) (<0,3,1>) 



(< 1,0,3 >) (<0,2,2>) 



£~0,1,2>) 

The worst . 1 . 

P° mt ( ^0,0,4> ) 

Fig. 13. Poset e(S) = (m,V2,m) 



, S = X*Y *Z*V 
S 1= X 3 *Y 5 *Z 3 * V 4 

5 2 = X 3 *Y 5 *Z 2 * V 5 

5 3 = X 3 * Y 3 * Z 2 * V A 



■®X!(2) 
<*>X 2 (3) 
^X 3 (2) 



®Y 2 (2) 

Ks>r 4 (3) 
l®y 5 (2) 



€>Zi(2) 
€)Z 2 (1) 
^)Z 3 (2) 



®Vi(3) 
W 2 (2) 
^F 3 (2) 

KS3 1^(1) 
W 6 (2) 



Fig. 14. Example of composition 
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Table 7. Compatibility estimates 





Y 3 


Y 2 


Y 5 


Yi 


Yi 


z 2 




Z 3 




v 5 


v 2 


v 3 


Vi 


X 3 

x 1 
x 2 

Y 3 

Y 2 
Y 5 
Yx 
Y± 

z 2 

Zi 

z 3 


5050531444330 
0513025311113 
0315024311113 
2 5 1 4 2 1 1 5 
2 3 2 1 1 1 1 5 
5 1 5 5 5 5 5 1 
2 3 2 1 1 1 1 5 
5 3 5 1 1 1 1 5 
5 5 5 5 5 
5 5 5 5 5 
5 5 5 5 5 



The wo.rst 
point 




Fig. 15. Poset of system quality N(S) 



4.4. Modified version of HMMD method. Here combinatorial synthesis is 
based on usage of multiset estimates of design alternatives for system parts. For 
the resultant system 5 — 5(1) * ... * S(i) * ... * 5(m) the same multiset estimate 
is examined as an aggregated estimate ("generalized median") of corresponding 
multiset estimates of its components (i.e., selected DAs). In addition, a condition 
quality for the selected DAs is used. Thus, N(S) — (w(S);e(S)), where e(5) is 
the "generalized median" of estimates of the solution components. Evidently, the 
constraint for the resultant compatibility estimate in the obtained solution is used 
as well. Finally, the modified problem is (two objectives, two constraints): 

m 

max e(5) = M 9 = argmin | l+J S(M,e{Si)) |, 
Men ^ 

max w(S), 
s.t. e(5j) y e Q , Vi = l,m; 



w(S) > 1. 
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Note, the usage of the aggregated multiset estimate for composite system S provides 
the opportunity to use the same type of multset estimate (e.g., P 32 , P 33 , P 3 ' 4 ) 
computing of the system quality (i.e., N(S)) at various hierarchical layers of a multi- 
layer hierarchical system (during the 'Bottom-Up' system design framework). The 
constraint e(Si) >z e a , Vi = l,m provides selection of only "good" DAs (level e D 
can be changed, e.g., e 6 ' = (0,2,1)). Here estimate e is used as a "reference 
point" . Evidently, it is possible to use several similar constraints based on several 
"reference points" (e.g., e^' 3 = (0,3,0), ef 3 = (1, 1, 1)). 

It is necessary to point out the basic modified version of HMMD method has 
been described. It is possible to consider two other versions: 

Version 1: Integrated estimate for the composed system (objective 1): 

m 

max e(S) = |+J e(Si). 
i=i 

This case leads to changing the assessment problem for system: P L/n => p'.^x™. 

Version 2: Aggregated estimate for the composed system (objective 1) as the 
"set median": 

m 

max e(S) = M s = argmin | |+J 6(M,e(Si)) \. 

M£{e(S,),..,e(S m )} ^ 

Evidently, here an approximation is used and the computational complexity is 
decreased (to polynomial case, i.e., selection of a system component estimate). 

4.5. Example: three-component system, three-element assessment. Here 
three component system with assessment problem P 3 ' 3 is considered. Thus, priori- 
ties of DAs are evaluated by assessment problem P 3 ' 3 (see Fig. 5). The illustrative 
example is presented in Fig. 16 (3-position priorities are shown in parentheses), 
compatibility estimates from Table 6 are used. This example is close to example 
from Fig. 10. The poset for integrated estimates of quality for 3-component system 
and assessment problem P 3 ' 3 is presented in Fig. 17. Note, the following points 
of the basic lattice are impossible: < 8, 0, 1 >, < 7, 0, 2 >, < 5, 0, 4 >, < 4, 0, 5 >, 
< 2,0,7 >, and < 1,0,8 >. 

a s=x*y*z 

"S\ = X 1 *y 1 *Z 2 (3;2,5,2) 
S\ =X 2 *y 1 *Z 2 (2;4,3,2) 
S3 1 =X 3 *y 2 *^i(l;8,l,0) 

■®X! (0,3,0) <s)Yi(0,l,2) <§>Zi(3,0,0) 
<®X 2 (2,1,0) €»y 2 (2,l,0) <8>Z 2 (2,1,0) 
^5)X 3 (3,0,0) ^F 3 (0,0,3) 1®Z 3 (0,1,2) 

i®y 4 (o,i,2) 

Fig. 16. Example of composition 
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The ideal f< 9,0,0 >) 
point V — LJ J 



(<8,1,0>) 



(<7,2,0>) 



( < 7,1,1 >) ^ 6,3,0 > ) 



£ 6, 2, 1 >) ( < 5,4,0 >) 



^ 6,1,2 >) 5, 3, 1 >) ( c 4, 5, >) 



^ 6,0,3 >) ( <: 5, 2, 2 >) ( c 4, 4, 1 >) 3,6,0 > ) 



^5,1, 3>) (<4,3, 2>) ^ 3,5,1 >) g 2,7,0 >) 



^ 4,2,3 >) g 3,4,2 >) ^2,6,1 >) g 1,8,0 >) 



( < 4, 1,4 > ) ( < 3, 3, 3 > ) ( < 2, 5, 2 > j ( < 1,7, 1 > j ( < 0,9,0 > j 



(<3,2,4>) g 2,4,3 >) (< 1,6,2 >) (<0,8,1>) 



^ 3,1, 5 >) (<2,3,4>) (< 1,5, 3 >) (<0,7,2>) 



^3,0,6 >) 2, 2, 5 >) (< 1,4,4 >) 0,6,3 ^ 



(<2,1,6>) (< 1,3,5 >) g 0,5,4 >) 



^ 1,2,6 >) ( c 0, 4, 5 >) 



^ 1,1,7>) ^ 0, 3, 6 >) 



(<0,2,7>) 



(<0,1,8>) 



Fig. 17. Posct e (S) = Op 3 ' 3 ) 
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Now, let us consider three modified versions of HMMD: (i) integrated estimate 
for system quality (version 1), (ii) aggregated estimate for system quality (version 2, 
"set median"), and (ii) aggregated estimate for system quality (basic version, "gen- 
eralized median"). The illustration is targeted to system estimates. The considered 
solutions correspond to the solutions in Fig. 10. 

In the case 1 (integrated system estimate), the following solutions and their 
estimates are examined: 

(a) Si =X 1 *Y 1 * Z 2 , N(Sl) = (3; 2, 5, 2), 

(b) S\ =X 2 *Y 1 * Z 2 , N(S$) = (2; 4, 3, 2), 

(c) S 1 =X 3 *Y2*Z U N(Si) = (1;8,1,0). 

Fig. 18 illustrates the general poset of system quality (each local poset for 
w = 1, 2, 3 corresponds to the poset from Fig. 17). 




w = 1 

Fig. 18. Poset of system quality N(S) 



In the case 2 (aggregated system estimate as "set median"), the following solu- 
tions and their estimates are considered (the poset from Fig. 11 is used): 

(a) Si = X 1 *Y 1 * Z 2 , N{Sf) = (3; 0, 3, 0), 

(b) SI =X 2 *Yn< Z 2 , N(S$) = (2; 2, 1, 0), 

(c) SI = X 3 *Y 2 *Z U N(Sl) = (1; 3, 0, 0). 

In the case 3 (aggregated system estimate as "generalized median"), the following 
solutions and their estimates are considered (the poset from Fig. 11 is used): 

(a) Sf = X 1 * Y 1 * Z 2 , N{Sl) = (3; 0, 3, 0), 

(b) Si = X 2 * Yi * Z 2 , N(S§) = (2; 2, 0, 1) or iV(5|) = (2; 1, 2, 0) (incomparable 
estimates, i.e., two "generalized medians"), 

(c) SI = X 3 *Y 2 *Z U N(S$) = (1; 3, 0, 0). 

Note the cases 2 and 3 are more easy from the viewpoint of the future usage 
in multi- layer systems at the higher hierarchical layer (i.e., assessment problem for 
composite system and the corresponding multiset system estimate are more easy). 

4.6. Example: four-component system, four elements assessment. Here 
three component system with assessment problem P 3 ' 4 is considered. Thus, priori- 
ties of DAs are evaluated by assessment problem P 3 ' 4 (sec Fig. 6). The illustrative 
example is presented in Fig. 19 (4-position priorities are shown in parentheses), 
compatibility estimates from Table 7 are used. 
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Three modified versions of HMMD are considered: (i) integrated estimate for 
system quality (version 1), (ii) aggregated estimate for system quality (version 2, 
"set median"), and (ii) aggregated estimate for system quality (basic version, "gen- 
eralized median"). The illustration is targeted to system estimates. The considered 
solutions correspond to the solutions in Fig. 14. 



S = X-kY-kZ*V 



s\ 



X3*y 5 *Z 3 *V4(4;6,9,l) 
X 3 *Y 3 * Z 2 *Vi{2; 12, 4,0) 



■®X 1 (0,4,0) 
<s>X 2 (0,l,3) 
^X 3 (l,3,0) 



v 



<§>Yi(0,0,4) ^)Zi(l,3,0) ^)Vi(0,l,3) 
<S>Y 2 (1,2,1) ^Z 2 (4,0,0) 0^(1,3,0) 

€»y 3 (3,i,o) ^)Z 3 (o,3,i) <s)y 3 (i,2,i) 
«y 4 (o, i,3) <*)y 4 (4,o,o) 

^y (1,3,0) W 5 (0,3,l) 
Fig. 19. Example of composition 

In the case 1 (integrated system estimate), the following solutions and their 
estimates are examined (Fig. 20 depicts the general poset of system quality): 

(a) Si = X 3 * y 5 * Z 3 * y 4 , N(Sl) = (4; 6, 9,1), 

(b) S\ = X 3 *Y 3 *Z 2 *V 4 , N{S\) = (2; 12, 4, 0). 



The 




Fig. 20. Poset of system quality N(S) 

In the case 2 (aggregated system estimate as "set median"), the following solu- 
tions and their estimates are considered: 

(a) Sf =X 3 *Y 5 *Z 3 * y 4 , N(Sf) = (4; 1, 3, 0), 

(b) Sf = X 3 * y * Z 2 * V A , here two "set medians" exist: (3, 1, 0) or (4, 0, 0), the 
best "set median" is selected: N(S 2 ) = (2; 4, 0,0). 

In the case 3 (aggregated system estimate as "generalized median"), the following 
solutions and their estimates are considered (the poset from Fig. 11 is used): 

(a) Sf =X 3 *Y 5 *Z 3 * y 4 , N(Sf) = (4; 1, 3, 0), 

(b) Sf = X 3 ★ y 3 * Z 2 * V4, here two "generalized medians" exist: (3, 1,0) or 
(4,0,0), the best "generalized median" is selected: iV(Sf) = (2; 4, 0,0). 
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4.7. Example: Three-layer Hierarchical System. Here three-layer hierarchi- 
cal system with assessment problem P 3 ' 3 is examined (Fig. 21). 



S=A*B*C 

51 =A 1 *B 1 *C 2 (3,0,0) 

5 2 =A 2 * 5 2 *G 2 (2,1,0) 
S 2 =A 2 *B 2 *G 2 (2,1,0) 



, p = t*q*g*v 

Bi =T 3 *Q 5 *G 3 * ^ 4 (4; 1,3,0) 

P 2 = t 3 *q 3 *g 2 * 14(2; 4,0,0) 



01 



G 



V 



^)Ti (0,4,0) 
^T 2 (0,l,3) 
^T 3 (l,3,0) 



®Qi(0,0,4) €)Gi(l,3,0) 
<!>Q 2 (1,2,1) K§>G 2 (4,0,0) 
^Q 3 (3,1,0)^)G 3 (0,3,1) 
®Q 4 (0,1,3) 
1 ®Q B (1,3,0) 



Wi(0,1,3) 
W 2 (l,3,0) 

W(l,2,l) 

-® 14(4, 0,0) 
W 5 (0,3,l) 



) A = X*Y*Z 

A x =Xi*ri*Z 2 (3; 0,3,0) 

14 2 = X 2 *Y 1 *Z 2 (2; 1,2,0) 

14 3 = X 3 *y 2 *Z 1 (l;3,0,0) 




> C = H*J*U 
Gi =ffi*Ji*C^(3;0,l,2) 
G 2 = H 2 *J 3 *£/ 2 (2; 1,2,0) 
G 3 = H 3 *J 3 *?7 1 (1; 3, 0,0) 



<s>t/i(3,0,0) 
<s>t/ 2 (0,3,0) 
W 3 (0,2,l) 



W 4 (0,l,2) 

Fig. 21. Example of composition (three-layer system) 
Table 8. Compatibility 





Ji 


J 2 


J 3 




u 2 


(7 3 


Hi 


3 


1 





1 


3 


1 


H 2 


2 


1 


2 


1 


2 


2 


H 3 





1 


1 


1 


1 


1 


Ji 








2 


3 


2 


<h 








1 


1 





•h 








3 


2 


1 



The composition problem for subsystem A corresponds to the example from the 
previous sections (Fig. 16, Table 6). Thus, the following composite solutions are 
examined (case of "generalized median" ) : 

(a) At =Xi*Yi*Z 2 , N(Ai) = (3; 0,3,0), 

(b) A 2 = X 2 *Yi* Z 2 , N(A 2 ) = (2;1,2,0), 

(c) Aa=X 1 *Y 1 *Z 2 , N(A 3 ) = (1;3,0,0). 

The composition problem for subsystem B corresponds to the example from the 
previous sections (Fig. 19, Table 7). Thus, the following composite solutions are 
examined (case of "generalized median" ) : 
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(a) B 1 =T 1 *Q 1 *V 2 , JV(Bi) = (4; 0,3,0), 

(b) B 2 = T 2 * Qi * V 2 , N{B 2 ) = (2; 1, 2, 0). 

The following composite solutions are examined for subsystem C (compatibility 
estimates are presented in Table 8): 

(a) d = Hi * Ji * U 2 , JV(Bi) = (3; 0, 2, 1), 

(b) C 2 = H 2 * J 3 * C/ 2 , 7V(5 2 ) = (2; 1, 2, 0), 

(c) C 3 = H 3 *J 3 *U U N(B 3 ) = (1;3,0,0). 

The synthesis problem at the higher hierarchical layer is depicted in Fig. 22. 
Now, it is reasonable to consider several possible solving scheme for the compo- 
sition: 

Scheme 1. Combination of all possible composite solutions and an additional 
analysis of the solutions. 

Scheme 2. Combination of all possible composite solutions and the selection of 
the best solution(s) while taking into account their integrated multiset estimates. 

Scheme 3. Combination of all possible composite solutions and the selection of 
the best solution(s) while taking into account their aggregated multiset estimates. 

The resultant composite solutions are (including their integrated estimates, as- 
sessment problem p 310 7 alignment of estimates is not used; compatibility estimates 
are considered concurrently: w 1 = mm{w(A),w(B),w(C)}): 

S 1 =A 1 *B 1 * Ci, JV(Si) = (3; 1,8, 1); S 2 = A 1 *B 1 * C 2 , N(S 2 ) = (2; 2, 8, 0); 

S 3 = A x *Bt * C 3 , N{S 3 ) = (1; 4, 6, 0); 5 4 = A r * B 2 * C u N(S 4 ) = (2; 4, 5, 1); 

S 5 = A x * B 2 * C 2 , N(S 5 ) = (2; 5, 5, 0); S 6 = A 1 *B 2 * C 3 , N(S 6 ) = (1; 7, 3, 0); 

S 7 = A 2 * B 1 * C u N{S 7 ) = (2; 3, 6, 1); S S = A 2 *B 1 * C 2 , N(S 8 ) = (2; 4, 6, 0); 

S 9 = A 2 *B l *C 3 , N{S 9 ) = (1;6,4,0); S w =A 2 *B 2 *C 1 , N{S W ) = (2; 6, 3,1); 

S u = A 2 *B 2 *C 2 , N(Su) = (2; 7, 3,0); S 12 = A 2 *5 2 *C 3 , N(S 12 ) = (1;9,1,0); 

S 13 = A 3 *B 1 *C 1 , N(S 13 ) = (1:7,2, 1); S u = ^ 3 *B 1 *C 2 , N(S U ) = (1;5,5,0); 

5 16 = A^B^C'3, N(S U ) = (1;7,3,0); S ia = A 3 *B 2 *Cu N(S 16 ) = (1;7,2,1); 

5 17 = A 3 *B 2 *C 2 , N(S 17 ) = (2; 8, 2, 0); S 18 = A 3 *B 2 *C 3l N(S 18 ) = (1; 10, 0, 0). 



* S = A*B*C 

S 1 = Ai*Bi*Ci(3;l,8,l) 
5it - A 3 *B 2 *C 2 (2;8,2,0) 
Si 8 = i4 3 *B2*C , 3 (l;10,0,0) 

^ Ai(3; 0,3,0) KS)Si(4; 1,3,0) ^ Ci(3; 0, 2, 1) 
<s>A 2 (2;2,l,0) ^5 2 (2;4,0,0) <§>C 2 (2; 1,2,0) 
W 3 (l;3,0,0) 1®C 3 (3; 0,2,1) 

Fig. 22. Composition at higher hierarchical layer 



Evidently, three Pareto-efficient solutions are obtained (Fig. 22): 

(a) Sx = A 1 *B 1 *C 1 = {X 1 * Yi * Z 2 ) * (T 3 * Q 5 * G 3 * 14) * (Hi * Ji * C/ 2 ); 

(b) s 17 = a 3 *b 2 *c 2 - (x 3 *y 2 *z 1 )*(r 3 *o 3 *G 2 *y 4 )*(H 2 * J 3 *^ 2 ); 

(c) 5i 8 - A 3 *5 2 *C 3 = (X 3 *Y 2 *Z 1 )*(T 3 *Q 3 *G 2 *V 4 )*(H 3 *J 3 *U 1 ). 
Fig. 23 illustrates the general poset of system quality (each local poset for 

w = 1, 2, 3 corresponds to assessment problem P 3 ' 10 ). 

Note, the usage of aggregated multiset estimates does not increase the dimension 
of assessment problem at the higher hierarchical layer. On the other hand, it may be 
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necessary to examine additional compatibility estimates at the higher hierarchical 
layer as well (i.e., compatibility between design alternatives for A, B, and C). 




Fig. 23. Poset of system quality N(S) 



5. Multiset Estimates in Knapsack-like Problems 

Let us consider basic knapsack-like problems and their modification in the case 
of multiset estimates. The basic knapsack problem is (e.g., [2J, [5J): 

m 

max^ CiXi 

i=l 

m 

s.t. X] a,iXi < b, Xi G {0, 1}, i = 1, m 

i=l 

where Xi = 1 if item i is selected, for «th item Cj is a value ('utility'), and et^ is a 
weight (i.e., resource requirement). Often nonnegative coefficients are assumed. 

In the case of multiple choice problem, the items are divided into groups and 
it is necessary to select elements (items) or the only one element from each group 
while taking into account a total resource constraint (or constraints) (e.g., [2J, [B]): 

m <?i 

i=i j=i 

m qi qi 

S.t. X X a i5 X ij - ^ X Xi * - ll i = l i m i x ij e {°; !}■ 
i=l j = \ j=l 

The knapsack-like problems above are NP-hard and can be solved by the fol- 
lowing approaches ([2], [6j): (i) enumerative methods (e.g., Branch-and-Bound, dy- 
namic programming), (ii) fully polynomial approximate schemes, and (iii) heuristics 
(e.g., greedy algorithms). 

In the case of multiset estimates of item "utility" e;,z £ {1, i, n} (instead 
of Cj), the following aggregated multiset estimate can be used for the objective 
function ( "maximization" ) : 

(a) an aggregated multiset estimate as the "generalized median" , 

(b) an aggregated multiset estimate as the "set median" , and 

(c) an integrated multiset estimate. 
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First, let us consider a special case of multiple choice problem as follows: 

(1) multiset estimates of item "utility" eij,i 6 {1, i, n},j = l,<ft (instead 

Of Cij), 

(2) an aggregated multiset estimate as the "generalized median" (or "set me- 
dian") is used for the objective function ("maximization"). 

The initial item set is: 

{(1, 1), (1, 2), (1, gi ), (i, 1), (*, 2), (i, Qi ), (n, 1), (n, 2), (n,q n )}. 

Boolean variable Xij corresponds to selection of the item The solution is a 

subset of the initial item set: S — {(i,j)\xij — 1}. The problem is: 

max e(S) — max M — argmin | |+J 5(M,eij) |, 

MeD (»,j)es={(»,j)|x 4 ,i=i} 

s.t. y^y^ffljj^tj < &; y^^»j = l; ^ e {0,1}- 

i=l j=l j=l 

Here X^2=i Sj=i = S(»j)es ■ Evidently, this problem is similar to the above- 
mentioned combinatorial synthesis problem without compatibility of the selected 
items. Now let us consider a numerical example (Table 9). Some solutions for basic 
multiple choice problem (constraint: J2f=i x ij = 1) are: 

(a) S(b = 7) = {(1, 2), (2, 1), (3, 2), (4, 2)}, c(S(b = 7)) = 16.1; 

(b) S(b = 8) = {(1, 2), (2, 1), (3, 3), (4, 2)}, c(S(b = 8)) = 17.1. 

Here an estimate of computational complexity for a dynamic programming method 
is as follows: 

0( Ql J") + 0(q 2 n 1 ' 2 *) + ... + 0(q m pU™- 1 )*) < 0(m max ^ m ~^). 

i—l,m 



Table 9. Multiple choice problem 





Basic problem 


Assessment P 3 ' 3 




a ij 


Cij 




(1,1) 


1.3 


3.4 


(1,2,0) 


(1.2) 


3.1 


8.1 


(3,0,0) 


(1.3) 


0.7 


1.3 


(0,1,2) 


(2,1) 


2.0 


4.1 


(2,1,0) 


(2,2) 


1.3 


2.3 


(0,2,1) 


(3,1) 


3.0 


2.6 


(0,3,0) 


(3,2) 


0.6 


1.3 


(0,1,2) 


(3,3) 


1.6 


2.7 


(0,3,0) 


(4,1) 


2.0 


2.7 


(0,3,0) 


(4,2) 


1.3 


2.6 


(0,3,0) 


(4,3) 


3.3 


4.2 


(2,1,0) 


(4,4) 


2.3 


3.4 


(1,2,0) 



Some solutions for multiple choice problem with multiset estimates and inte- 
grated multiset estimate for the solution (constraint: J2f=i x ij = 1) are: 
(a) S z (b = 7) = {(1, 2), (2, 1), (3, 2), (4, 2)}, e 3 < 12 (S'(6 - 7)) = (5, 5, 2); 
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(b) S T (b = 8) = {(1, 2), (2, 1), (3, 3), (4, 2)}, e 3 > 12 (S 7 (& = 8)) = (5, 7, 0); and 

(c) S^b = 11.4) = {(1, 2), (2, 1), (3, 1), (4, 3)}, e 3 - 12 (S'(6 = 11.4)) = (7, 5, 0). 
Some solutions for multiple choice problem with multiset estimates and "gener- 
alized median" estimate for the solution (constraint: YLf=i x ij — 1) are: 

(a) S<>(b = 7) = {(1,2), (2,1), (3, 2), (4, 2)}, e 3 ' 3 (S»(6 = 7)) = (1,2,0) (two 
"generalized median" estimates exist: (1,2,0) and (0,3,0)); 

(b) S°(b - 8) - {(1,2), (2,1), (3, 3), (4, 2)}, e^(S°(b = 8)) = (2,1,0) (two 
"generalized median" estimates exist: (2, 1,0) and (1,2,0)); and 

(c) S" (b = 11.4) = {(1, 2), (2, 1), (3, 1), (4, 3)}, e 3 ' 3 (S^b = 11.4)) = (2, 1, 0). 
Some solutions for multiple choice problem with multiset estimates and "set 

median" estimate for the solution (constraint: Y^jLi x ij = 1) are: 

(a) S°(b = 7) = {(1, 2), (2, 1), (3, 2), (4, 2)}, e^(S s (b = 7)) = (2, 1, 0) 
(two "median set" estimates exist: (0,3,0) and (2, 1,0)); 

(b) S s (b = 8) = {(1,2), (2,1), (3, 3), (4, 2)}, e^(S s (b = 8)) = (2,1,0) (two 
"median set" estimates exist: (0,3,0) and (2,1,0)); and 

(c) S s (b = 11.4) = {(1, 2), (2, 1), (3, 1), (4, 3)}, e 3 > 3 (S s (6 = 11.4)) = (2, 1, 0). 

In other cases when the condition in knapsack-like problem is an inequality (e.g., 
Sj=i x ij — 1)' ^ i s necessary to consider an integrated multiset estimate for the 
solution. Here it is reasonable to describe a special approach to integration of 
different assessment multiset problems: 

^pl,Vi phm pLy m | . v pl,q 

where r\ = max- = — \r\i\. First, poset for assessment problem P l ' v is extended by 
addition of posets for problems P 1 -^ \/r]i < r/. Secondly, the preference rules of the 
following type are added (for comparison of multiset estimates from different posets 
above): 

PI P2 Pl+1 P3 

(C^M,C~o) >- (C^o,/3,CiT^ZT), 

where pi + 1 + p 2 < I, Pi + 2 + p 3 < I, ft > 1, ( K > Vk = l,P3. The described 
approach is targeted to comparison of multiset estimates with different numbers 
of elements: r/i ^ r\2- This is significant for basic knapsack problem and multi- 
ple choice problem because the number of elements in different solutions may be 
different. 

Example 20. 

(a) e?' 2 - (1,1,0), e 3 ' 3 = (0,0,3), e 3 ' 2 y e 3 / 

(b) e^ 1 = (1,0,0), ef = (0,3,0), e^Vef 

(c) ef 1 = (0,1,0), e 3 / = (0,0,5), ejj'V eg' 6 

(d) e 3 / = (1,0,0), e 3 / = (0,3,2), ef 1 y e 3 / 

(e) e 3 / = (0, 2, 0), e 3 * = (0, 1, 5), e 3 / 1 y e 3 { 3 

Further, basic multiple choice problem with multiset estimates is: 
max e(S) = |+J e^j, 

(»,j)€S={(»,j)| a ; i , J = l} 
m qi qi 

s-t. ^2^2<iij x i,j < b; < 1; e {0,1}. 

i=l j=l j=l 
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Here solutions for multiple choice problem with multiset estimates and the inte- 
grated estimate for the solution (constraint: Y^f=i x ij — 1) are (Table 9): 

(a) S(b = 5.1) = {(1, 2), (2, 1)}, e'(S(& = 5.1)) = (5, 1, 0); 

(b) S(b = 8.4) = {(1, 2), (2, 1), (4, 3)}, e'(S(6 = 8.4)) - (7, 2, 0). 

Note, e I (S(b = 8.4)) >- e I (S(b = 5.1)). Here an estimate of computational 
complexity for a dynamic programming method is as follows: 

0( qi /*'■") + 0(q 2 (^ 2r > + /*'■")) + ... + 0(q m {^ m -^ + /(m-2)r ; + ... + ^) < 

0(m 2 max{ % } /x^ 1 ™" 1 )"). 

Knapsack problem with multiset estimates and the integrated estimate for the 
solution is (solution S — {i\xi = 1}): 

max e(S) = (+J ej, 
ies={i\x i= i} 

m 

s.t. ^^aiXi <b; x { e {0,1}. 

i=l 

A numerical example for knapsack problem is presented in Table 10. 



Table 10. Knapsack problem 



i 


Basic problem 


Assessment P 3 ' 3 




di 




e 3,3 


1 


1.3 


3.4 


(1,1,1) 


2 


3.1 


7.9 


(3,0,0) 


3 


0.7 


1.3 


(0,1,2) 


4 


2.0 


4.1 


(1,2,0) 


5 


1.3 


2.3 


(0,2,1) 


6 


3.0 


5.6 


(2,1,0) 


7 


1.3 


2.8 


(0,3,0) 



Some solutions for basic knapsack problem (constraint: YLf=\ x ij — 1) are: 

(a) S(b = 5.1) = {1, 2, 5}, c(S(b = 5.1)) = 13.2; 

(b) S(b = 5.7) = {1, 2, 7}, c(S(b = 5.7)) = 14.1; 

(c) S{b = 7.7) = {1,2,4, 7}, c(S(b = 7.7)) = 18.2; and 

(d) S(b = 8.4) = {1, 2, 3, 4, 7}, c(S(b = 8.4)) = 19.5. 

Here e T {S{b = 8.4)) > e 7 (S(& = 7.7)) > e z (S(b = 5.7)) > e J (S(6 = 5.1)). 
Some solutions for knapsack problem with multiset estimates and the integrated 
estimate for the solution (constraint: Y^j=i x ij — 1) are: 

(a) S(b = 5.1) = {1, 2, 5}, e'(S(6 = 5.1)) = (4, 3, 2); 

(b) S(b = 5.7) = {1, 2, 7}, e 7 (S(6 = 5.7)) = (4, 4, 1); 

(c) S(b = 7.7) = {1,2, 4, 7}, e J (£(6 = 7.7)) = (5, 6, 1); and 
(c) S(b = 8.4) = {1, 2, 3, 4, 7}, e 7 (S(6 = 8.4)) = (5, 7, 3). 

Note, e / (S'(6 = 8.4)) >- e J (S(6 = 7.7)) >- e J (5(6 = 5.7)) >- e T (S(b = 5.1)). Here 
an estimate of computational complexity for a dynamic programming method is as 
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follows: 

0(M^ r ')+0((M^ 2, 'V' ?, ))+-+0((Ai i ' (m_1)l 'V' (m_2) "+-V'' ? ) < CKmV^- 1 )"). 
Clearly, multiset estimates can be used for resource constraint(s) as well. 

6. Multiset Estimates and Multi- attribute Alternatives 

Let A = {A\, At, A n } be the set of alternatives, C — {Ci, Cj, C m } 
be the set of attributes (criteria), e/J be the multiset estimate of alternative Ai 
upon criterion Cj (i.e., assessment problem P 1 ' 71 is used at all processing stages). 
Thus, the estimate vector for alternative Ai is: 

V c i,l' •••) •••) ^i.ml- 

Definition 1. The aggregated multiset estimate for alternative Ai is ("median" 
M is considered as "generalized median" or "set median" ) : 

m 

e l <2{Ai) = M = argmin | M 5(M, e^) |. 

Definition 2. The vector estimate for median alternative Am is defined as 
follows ("median" M is considered as "generalized median" or "set median"): 

where 

m 

e l « . = argmin \M S(M,ety |. 

The aggregated multiset estimate for alternative Ai (e^(Ai)) and the median 
alternative Am can be used at preliminary stages in combinatorial synthesis. 

Application of multiset estimates in real-world problems requires taking into 
account the following basic requirements: 

1. correspondence to applied problem (and evaluation processes), 

2. easy to use for domain experts, 

3. limited computing complexity of the used computer procedures. 

In many applications, the suggested multiset estimates can be used as a sim- 
ple approximation of traditional fuzzy-set based estimates (or histogram-like esti- 
mates). Let us consider assessment problem P 6 ' 4 as an example. Fig. 24 illustrates 
several estimates for problem P 6,4 (assessment over scale [1,2,3,4,5,6] with four 
elements. 

Here "multiset coefficient" or "multiset number" is (i.e., the number of esti- 
mates): 

Evidently, the number (126) is the parameter for computational complexity and 
corresponding processing procedures will be sufficiently simple ("effective"). 
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1 2 3 4 5 6 



1 2 3 4 5 6 



1 2 3 



5 6 



1 2 3 4 5 6 



1 2 3 4 5 6 



1 2 3 4 5 6 



{3,3,3,4} or (0,0,3,1,0,0) 



{4,4,4,4} or (0,0,0,4,0,0) 



{2,3,4,4} or (0,1,1,2,0,0) 



{3,3,4,4} or (0,0,2,2,0,0) 



{2,3,4,5} or (0,1,1,1,1,0) 



{2,3,3,4} or (0,1,2,1,0,0) 



, , , ( , {2, 3, 4, 4} or (0,1, 1,2, 0,0) 

Fig. 24. Examples of estimates (assessment P 6,4 ) 



7. Conclusion 

In the article, an approach to assessment of alternatives based on assignment 
of elements into an ordinal scale has been suggested. This kind of assessment 
corresponds to usage of special multiset based estimates (cardinality of multiset- 
estimate is a constant). Concurrently, the assessment approach provides evaluation 
from the viewpoint of uncertainty. Our evaluation process is based on an assignment 
procedure: for each alternative several elements (e.g., 1,2,3) are assigned to levels 
of an ordinal scale [1,2,. ..,1]. Here, the case of one element corresponds to well- 
known ordinal assessment. Several basic assessment problems are described: (i) 
traditional assessment on ordinal scale [1,2, 3] (-P 3,1 ); (h) traditional assessment on 
ordinal scale [1,2,3,4] (Pi 4 - 1 ); (hi) assessment on ordinal scale [1,2,3] based on 
assignment of two elements (P 3 ' 2 ); (iv) assessment on ordinal scale [1,2,3] based 
on assignment of three elements (P 3,3 ); and (v) assessment on ordinal scale [1, 2, 3] 
based on assignment of four elements (P 3 ' 4 ). For each assessment problem above, 
the following issues are examined: assessment scale, order over the scale components 
(posct). In addition, "interval multiset estimates" are suggested. 

For the suggested multiset estimates, operations over the estimates are examined: 
(a) integration, (b) proximity, (c) comparison, (d) aggregation (e.g., by computing 
a median estimate), and (e) alignment. The suggested assessment approach is used 
for combinatorial synthesis (morphological approach, knapsack- like problems). The 
assessment approach, multiset-estimates and corresponding problems are illustrated 
by numerical examples. 

In general, it is necessary to point out the following: 
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Note 1. The suggested assessment approach is based on expert judgment and/or 
computation procedures (including interactive mode and information visualization). 

Note 2. The considered simplified versions of the assessment problem based on 
small numbers of elements and levels of used ordinal scale are very useful for data 
presentation/ visualization and are often sufficient for many applications. 

Note 3. The described assessment methods are very understandable and useful 
for domain experts. A similar assessment scale is widely used in financial engineer- 
ing for evaluation of financial institutions (a version of the scale): 'AAA' , 'AAB', 
'ABB', 'BBB', 'BBC, 'BCD', etc. This corresponds to assessment problem P 3 < 4 
with scale [A, B,C,D] (Ay B >- C >- D). 

Note 4- The usage of the suggested assessment approach in composition problem 
leads to the extended version of HMMD method [IT] . 

Note 5. The suggested approach can be considered as an approximation of tradi- 
tional fuzzy set based assessment procedures. As a result, combinatorial estimates 
processing procedures based on posets (or lattices) can be used (presentation, com- 
putation). 

In the future, the following research directions can be considered: 

1. Usage of the suggested multiset assessment approach in decision support 
systems (including special visualization support subsystem and special human- 
computer interface). 

2. Comparison of the suggested approach and approaches, based on fuzzy sets 
(including aspects of computation and human-computer interaction). 

3. Usage of the suggested multiset approach for assessment of elements/alternatives 
in decision making problems: (i) sorting problems (e.g., [20], [25], [27], [38]); (ii) clus- 
tering, classification (e.g., 0,[IB],[25,[2S],[33],[1I],[22]). 

4- Analyzing the usage of the suggested multiset assessment in design and de- 
cision making procedures: (a) quality of the obtained solutions, (b) complexity of 
the solving schemes. 

5. Special studies of algorithms and their computational complexity for con- 
sidered combinatorial synthesis (e.g., combinatorial synthesis based on morpho- 
logical approach and combinatorial synthesis based on knapsack-like problems) 
(e.g., [1]], [15], [17], [19]) based on the suggested multiset assessment. Here the at- 
tention can be targeted to dynamic programming procedures. Note, analogues 
of FPTAS for knapsack-like problems (including intervals-based methods) (e.g., 
EJ,[5],[H],ES],[2H],[^],[3D],[31],ES]) can be successfully used for combinatorial syn- 
thesis (knapsack-like problems) in case of integrated multiset estimates for solutions. 
On the other hand, various hybrid heuristics and man-machine procedures have to 
be widely used for the suggested versions of combinatorial synthesis problems. 

6. Usage of the suggested approach for assessment of solution components in 
combinatorial optimization (e.g., scheduling problems, travelling salesman problem, 
routing problems, tree spanning problems, assignment problems, graph coloring 
problems) (e.g., [2] , [11] , [53] ) . 

7. Conducting some special psychological studies of the suggested multiset as- 
sessment approach. 

References 

[1] S. Alkhazalch, A.R. Salleh, N. Hassan, Soft multisets theory. Applied Mathematical Sciences, 
5(72), 3561-3573, 2011. 



MULTISET ESTIMATES AND COMBINATORIAL SYNTHESIS 



2!) 



[2] M.R. Garey, D.S. Johnson, Computers and Intractability. The Guide to the Theory of NP- 
Completeness, San Francisco, W.H. Freeman and Company, 1979. 

[3] G.V. Gens, E.V. Levner, Approximation algorithms for certain universal problems in sched- 
uling theory. Engineering Cybernetics, 16(6), 31-36, 1978. 

[4] A.K. Jain, M.N. Murty, P.J. Flynn, Data clustering: a review. ACM Computing Surveys, 
31(3), 264323, 1999. 

[5] H. Kellerer, R. Mansini, U. Pferschy, M.G. Speranza, An efficient fully polynomial approx- 
imation scheme for the Sub-Sum Problem. J. of Computer and System Sciences, 66(2), 
349-370, 2003. 

[6] H. Kellerer, U. Pferschy, D. Pisinger, Knapsack Problems, Berlin, Springer, 2004. 

[7] D.E. Knuth, The Art of Computer Programming. Vol. 2, Seminumerical Algorithms. Ad- 
dison Wesley, Reading, 1998. 

[8] M.Sh. Levin, An extremal problem of organization of data. Engineering Cybernetics, 19(5), 
87-95, 1981. 

[9] M.Sh. Levin, Hierarchical morphological multicriteria design of decomposable systems. Con- 
current Engineering: Research and Applications, 4(2), 111-117, 1996. 

[10] M.Sh. Levin, Towards comparison of decomposable systems. In: Data Science, Classifica- 
tion, and Related Methods, Springer, Tokyo, 154-161, 1998. 

[11] M.Sh. Levin, Combinatorial Engineering of Decomposable Systems. Dordrecht, Kluwer Aca- 
demic Publishers, 1998. 

[12] M.Sh. Levin, System synthesis with morphological clique problem: fusion of subsystem 
evaluation decisions, Inform. Fusion, 2(3), 225-237, 2001. 

[13] M.Sh. Levin, Towards combinatorial planning of human-computer systems, Applied Intelli- 
gence, 16(3), 235-247, 2002. 

[14] M.Sh. Levin, Modular system synthesis: example for composite packaged software, IEEE 
Trans, on SMC - Part C, 35(4), 544-553, 2005. 

[15] M.Sh. Levin, Composite Systems Decisions, New York, Springer, 2006. 

[16] M.Sh. Levin, Towards hierarchical clustering, In: V. Diekert, M. Volkov, A. Voronkov, 

(Eds.), CSR 2007, LNCS 4649, Springer, 205-215, 2007. 
[17] M.Sh. Levin, Combinatorial optimization in system configuration design, Automation and 

Remote Control, 70(3), 519-561, 2009. 
[18] M.Sh. Levin, Aggregation of composite solutions: strategies, models, examples. Electronic 

preprint. 72 pp., Nov. 29, 2011. |http://arxiv.org/abs/1111.6983| [cs.SE] 
[19] M.Sh. Levin, Morphological methods for design of modular systems (a survey) Electronic 

preprint. 20 pp., Jan. 9, 2012. |http://arxiv.org/abs/1201.1712| [cs.SE] 
[20] M.Sh. Levin, A. A. Mikhailov, Fragments of Objects Set Stratification Technology, Preprint, 

Moscow, Inst, for Systems Studies (RAS), 60 p., 1988 (in Russian) 
[21] B.G. Mirkin, Clustering for Data Mining: A Data Recovery Approach. Chapman & Hall / 

CRC, 2005. 

[22] F. Murtagh, A survey of recent advances in hierarchical clustering algorithms. The Computer 

Journal, 26(), 354359, 1993. 
[23] C.H. Papadimitriou, K. Steiglitz, Combinatorial Optimization: algorithms and complexity. 

Dover Pubns, 1998. 
[24] W. Pedrycz, Knowledge- Based Clustering. Wiley, 2005. 

[25] A.B. Petrovsky, Clustering and sorting multi-attribute objects in multiset metric space. J^th, 
Int. Conf. Intelligent Systems IS 2008, 1144-1148, 2008. 

[26] K. Pruhs, G.J. Woeginger, Approximation schemes for a class of subset selection problems. 
Theoretical Computer Science, 382(2), 151-156, 2007. 

[27] B. Roy, Multicriteria Methodology for Decision Aiding, Dordrecht, Kluwer Academic Pub- 
lishers, 1996. 

[28] S. Sahni, Approximate algorithms for 0/1 knapsack problem. J. of the ACM, 22(1), 115-124, 
1975. 

[29] S. Sahni, Algorithms for scheduling independent tasks. J. of the ACM, 23(1), 116-127, 1976. 
[30] S. Sahni, E. Horowitz, Combinatorial problems: reducibility and approximation. Oper. Res., 
26(5), 718-759, 1978. 

[31] C. Solnon, J.-M. Jolion, Generalized vs set median string for histogram based distances: 
Algorithms and classification results in image domain. In: F. Escolano, M. Vento (Eds.), 



30 



MARK SH. LEVIN 



Proc. of the 6th Workshop on Graph Based Representation in Pattern Recognition GbPrP 

2007, LNCS 4538, Springer, 404-414, 2007. 
[32] A. Syropoulos, Mathematics of multisets. In: C.S. Calude et. al. (Eds.), Multiset Processing: 

Mathematical Computer Science, and Molecular Computing Points of View. LNCS 2235, 

Springer, 347-358, 2001. 
[33] J. Van Ryzin, (cd.), Classification and Clustering. New York, Academic Press, 1977. 
[34] A. Warburton, Approximation of pareto optima in multiobjective shortest path problem. 

Oper. Res., 35, 70-79, 1987. 
[35] G.J. Woeginger, When does a dynamic programming formulation guarantee the existence 

of a fully polynomial approximation scheme (FPTAS)? INFORMS J. on Computing, 12(1), 

57-75, 2000. 

[36] R.R. Yager, On the theory of bags. Int. J. of General Systems, 13(1), 23-37, 1986. 
[37] L.A. Zadeh, Fuzzy sets. Information and Control, 8(3), 338-353, 1965. 

[38] C. Zopounidis, M. Doumpos, Multicriteria classification and sorting methods: A literature 

review. Eur. J. of Oper. Res., 138(2), 229-246, 2002. 
[39] H.J. Zimmerman, Fuzzy Sets, Decision Making, and Expert Systems. Berlin, Springer, 1987. 

Mail address: Mark Sh. Levin, Sumskoy Proezd 5-1-103, Moscow 117208, Russia; 
Http: //www. mslevin.iitp.ru/ 
E-mail address: mslevin<Sacm.org 



